Application No. 10/540,972 

Amendments to the Claims : 

The following listing of claims will replace all prior versions, and listings, of claims in 

the application: 

1 . (Currently Amended) An image processing apparatus comprising: 

an image obtaining unit that obtains an image captured with an image sensor_forgugh 

an optical system ; and 

a defect information generating unit that generates defect information indicating a 
defect within the image having been obtained, based upon a value at a target pixel and an 
average value of a plurality of pixel values corresponding to pixels present within a 
predetermined range containing the target pixel, wherein: 

tho imago o e noor captures an image through an optical system; and 
the defect information is information on a projected image of a defect within an 
optical path, which manifests in the-k»age jrnage^ 

the defect information generating unit simul t aneously generates information indicating 
a position of the projected image of the defect within the optical path and information 
indicating intensity of the projected imag e of the defect within the optical path and records 
the position information and the intensity i nformation, and 

the defect information generating unit incl u des a relative ratio calculation unit that 
calculates a relative ratio of the value at the target pi x el and the average value of the plurality 
of nixel values corresponding to the pixels nresent w i thin the predetermined range containing 
the target pixel, and generates the defect informatio n based upon the calculated relative ratio . 
2.-4. (Canceled) 

5 . (Previously Presented) An image processing apparatus comprising: 
an image obtaining unit that obtains an image captured with an image sensor; 



-2- 



Application No. 10/540,972 

a defect information generating unit that generates defect information indicating a 
defect within the image having been obtained, based upon a value at a target pixel and an 
average value of a plurality of pixel values corresponding to pixels present within a 
predetermined range containing the target pixel; and 

a correction unit that corrects the defect within the image based upon the defect 
information, wherein: 

the defect information generating unit includes a relative ratio calculation unit that 
calculates a relative ratio of the value at the target pixel and the average value of the plurality 
of pixel values corresponding to the pixels present within the predetermined range containing 
the target pixel, and generates the defect information based upon the calculated relative ratio; 
and 

the correction unit corrects the defect by multiplying a value at a corresponding pixel 
by a reciprocal of the relative ratio. 

6. (Canceled) 

7. (Canceled) 

8. (Currently Amended) An image processing apparatus comprising: 

an image obtaining unit that obtains a reference image photographed through an 
optical system; and 

a defect information generating unit that generates defect information indicating a 
defect within the reference image having been obtained, based upon a value of a target pixel 
and an average value of a plurality of pixel values corresponding to pixels present within a 
predetermined range containing the target pixel in the reference image, wherein: 

the defect information is information on a projected image of a defect within an 
optical path, which manifests in the imag eimage, 
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the defect information generating unit simultaneously gen erates information indicating 

a position of the projected image of the defect w ithin the optical path and information 
indicating intensity of the projected image of the de fect within the optical path and records 
the position information and the intensity info rmation, and 

the defect information generating unit includes a relative ratio calculation unit that 

calculates a relative ratio of the value at the target pi x el and the average value of the plurality 
of pixel values corresponding to the pixels present within the pre determined range containing 
the target pixel, and generates the defect informati o n based upon the calculated relative ratio . 
9. (Previously Presented) An image processing apparatus comprising: 
an image obtaining unit that obtains a reference image photographed through an 
optical system; and 

a defect information generating unit that generates defect information indicating a 
defect within the reference image having been obtained, based upon a value of a target pixel 
and an average value of a plurality of pixel values corresponding to pixels present within a 
predetermined range containing the target pixel in the reference image, wherein: 

the defect information generating unit includes a relative ratio calculation unit that 
calculates a relative ratio of the value at the target pixel and the average value of the plurality 
of pixel values corresponding to the pixels present within the predetermined range containing 
the target pixel, and generates the defect information based upon the calculated relative ratio; 

the image obtaining unit obtains a correction target image photographed through the 
optical system; 

there is further provided a correction unit that corrects a defect within the correction 
target image based upon the defect information within the reference image; and 
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the correction unit corrects a value of a corresponding pixel in the correction target 
image by multiplying the value of the corresponding pixel with a reciprocal of the relative 
ratio calculated for the reference image. 

1 0. (Currently Amended) An image processing apparatus according to claim 9, 
comprising: 

an imag e obtaining unit that obtains a reference imago photograph e d through an 

optical system; 

a defect information g e n e rating unit that generates d e f e ct information indicating a 

defect within the r e ferenc e imago having b e en obtained, based upon a value of a targ e t pixel 
and an average value of a plurality of pixel values corresponding to pixels pr e sent within a 
predetermined range containing th e target pix e l in the reference image, wh e r e in: 

the imago obtaining unit obtains a correction target imag e photographed through th e 

optical syst e m; 

there is further provided a correction unit that corrects a def e ct within the correction 

target imag e bas e d upon the defect information within th e reference imago; and 

wherein: t he correction unit determines fr-the correction value by using an initial signal 
value indicated at a specific correction target pixel position. 

1 1 . (Previously Presented) An image processing apparatus according to claim 9, 
wherein: 

if the reference image and the correction target image have been photographed 
through an optical system in substantially identical optical conditions with regard to an 
aperture value and a pupil position, the correction unit corrects a value at a pixel constituting 
the correction target image by directly using the defect information having been generated. 

12. (Previously Presented) An image processing apparatus according to claim 9, 
further comprising: 

-5- 



Application No. 10/540,972 

a defect information conversion unit that converts the defect information in 
correspondence to at least either of an aperture value and a pupil position constituting optical 
conditions of the optical system, wherein: 

if the reference image and the correction target image have been photographed 
through the optical system under different optical conditions with regard to at least either the 
aperture value or the pupil position, the correction unit corrects a value at a pixel constituting 
the correction target image by using the converted defect information. 

13.-18 (Canceled) 

19. (Withdrawn) An image processing apparatus comprising: 

an image obtaining unit that obtains an image captured by using an image sensor 
capable of separating light into a plurality of colors; 

a luminance signal generating unit that generates a luminance signal based upon 
signals of the plurality of colors constituting the image; 

a defect information generating unit that generates defect information indicating a 
defect within the image based upon the luminance signal for the image having been 
generated; and 

a correction unit that corrects a value corresponding to a color component at a 
defective pixel within the image by using the defect information. 

20. (Canceled) 

21 . (Withdrawn) An image processing apparatus according to claim 19, further 
comprising: 

a defect information generating unit that generates defect information indicating a 
defect within the image having been obtained based upon a value indicated by the luminance 
signal generated for a target pixel and an average value among values indicated by luminance 
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signals generated for a plurality of pixels within a predetermined range containing the target 
pixel. 

22. (Withdrawn) An image processing apparatus according to claim 21, wherein: 
the defect information generating unit includes a relative ratio calculation unit that 

calculates a relative ratio of the value indicated by the luminance signal generated for the 
target pixel and the average value of the luminance signals generated for the plurality of 
pixels within the predetermined range containing the target pixel, and generates the defect 
information based upon the relative ratio having been calculated. 

23. (Withdrawn) An image processing apparatus according to claim 21, further 
comprising: 

a correction unit that corrects a value corresponding to a color component at a 
corresponding pixel by multiplying the value by a reciprocal of the relative ratio. 

24. -36. (Canceled) 

37. (Withdrawn) An image processing apparatus comprising: 

an image obtaining unit that obtains a first image photographed through an optical 
system and a second image photographed under optical conditions different from optical 
conditions in which the first image is photographed; and 

a defect information generating unit that generates defect information indicating a 
defect in the first image or the second image by using the first image and the second image, 
wherein: 

the first image and the second image are photographed under different optical 
conditions with regard to at least either of an aperture value and a pupil position. 

38. (Withdrawn) An image processing apparatus according to claim 37, further 
comprising: 
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a correction unit that corrects a defect in the first image or the second image by using 
the defect information. 

39. (Canceled) 

40. (Withdrawn) An image processing apparatus according to claim 37, wherein: 
the defect information generating unit includes an optical condition conversion unit 

that converts at least either the first image or the second image so as to conform to a specific 
optical condition, in order to eliminate a mismatch of the optical conditions for the first image 
and the second image. 

41 . (Withdrawn) An image processing apparatus according to claim 40, wherein: 
if the optical conditions with regard to the aperture value are different, the optical 

condition conversion unit executes low pass filter processing on a pixel signal generated 
based upon the first image or the second image so as to convert a defect state corresponding 
to the first image or the second image to a defect state estimated to manifest at a matching 
aperture value. 

42. (Withdrawn) An image processing apparatus according to claim 41 , wherein: 
the optical condition conversion unit executes conversion by using a substantially 

uniformly weighted low pass filter. 

43. (Withdrawn) An image processing apparatus according to claim 40, wherein: 
if the optical conditions with regard to the pupil position are different, the optical 

condition conversion unit executes displacement processing through which a pixel signal 
generated based upon the first image or the second image is displaced from a center of an 
optical axis of the optical system along a direction of a radius vector so as to covert a defect 
state corresponding to the first image or the second image to a defect state estimated to 
manifest at a matching pupil position. 
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44. (Withdrawn) An image processing apparatus according to claim 43, wherein: 
the optical condition conversion unit executes displacement processing through which 

a pixel signal located further away from the center of the optical axis is shifted to a greater 
extent along the radius vector. 

45. (Withdrawn) An image processing apparatus according to claim 43, wherein: 
the optical condition conversion unit executes the displacement processing by 

executing an arithmetic operation to predict an extent of displacement on an assumption that 
foreign matter causing the defect is present over a specific distance from an image-capturing 
surface within the optical system along the optical axis. 

46. (Withdrawn) An image processing apparatus according to claim 37, wherein: 
one of the first image and the second image is a correction target image to undergo 

correction and the other image is a reference image used to generate the defect information. 

47. (Withdrawn) An image processing apparatus according to claim 37, wherein: 
the first image and the second image are both correction target images to undergo 

correction; and 

the defect information generating unit generates defect information to be used 
commonly in conjunction with the first image and the second image by using the first image 

and the second image. 

48. (Withdrawn) An image processing apparatus according to claim 47, wherein: 
the defect information generating unit includes an optical condition conversion unit 

that converts at least either the first image or the second image so as to conform to a specific 
optical condition, in order to eliminate a mismatch of the optical conditions for the first image 
and the second image. 
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49. (Withdrawn) An image processing apparatus according to claim 46, wherein: 
the image obtaining unit obtains the reference image photographed at an aperture 

value corresponding to a narrowest aperture opening setting in an adjustable aperture value 

range of the optical system. 

50. (Withdrawn) An image processing apparatus according to claim 37, wherein: 
the defect information generating unit generates defect information indicating a defect 

within the image having been obtained, based upon a value of a target pixel and an average 
value of a plurality of pixel values corresponding to pixels present within a predetermined 
range containing the target pixel in the image. 

5 1 . (Withdrawn) An image processing apparatus according to claim 46, wherein: 
the image obtaining unit obtains a reference image photographed within a 

predetermined period of time preceding or following a time point at which the correction 
target image is photographed. 

52. (Withdrawn) An image processing apparatus comprising: 

an image obtaining unit that obtains a first image photographed through an optical 
system and a second image photographed under optical conditions different from optical 
conditions in which the first image is photographed; and 

a correction unit that corrects a defect contained within the first image or the second 
image by using the first image and the second image, wherein: 

the first image and the second image are photographed under different optical 
conditions with regard to at least either of an aperture value and a pupil position. 

53. (Canceled) 

54. (Withdrawn) An image processing apparatus comprising: 

an image obtaining unit that obtains a photographic image captured with an image 

sensor; 
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a flat portion extraction unit that extracts a flat portion area within the photographic 
image having been obtained; and 

a defect information generating unit that generates defect information corresponding 

to the extracted flat portion area. 

55. (Withdrawn) An image processing apparatus according to claim 54, further 

comprising: 

a correction unit that corrects an image within the flat portion area based upon the 
defect information. 

56. (Withdrawn) An image processing apparatus according to claim 54, wherein: 
the defect information corresponding to the flat portion area is generated based upon a 

value at a target pixel and an average value of a plurality of pixel values corresponding to 
pixels present within a predetermined range containing the target pixel in the image within 
the flat portion area. 

57. (Withdrawn) An image processing apparatus according to claim 56, wherein: 
the defect information generating unit includes a relative ratio calculation unit that 

calculates a relative ratio of the value at the target pixel and the average value of the plurality 
of pixel values corresponding to the pixels present within the predetermined range containing 
the target pixel, and generates the defect information corresponding to the flat portion area 
based upon the calculated relative ratio. 

58. (Withdrawn) An image processing apparatus according to claim 55, further 

comprising: 

a relative ratio calculation unit that calculates a relative ratio of a value at a target 
pixel and an average value of pixel values corresponding to a plurality of pixels present 
within a predetermined range containing the target pixel, among pixels constituting an image 
of the flat portion area, wherein: 
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the defect information generating unit generates the defect information corresponding 
to the flat portion area based upon the relative ratio having been calculated; and 

the correction unit uses a reciprocal of the relative ratio corresponding to a pixel in the 
image of the flat portion area when correcting a value of the corresponding pixel in the image 
of the flat portion area by multiplying the pixel value by the reciprocal. 

59. (Withdrawn) An image processing apparatus according to claim 58, wherein: 
the correction unit executes low pass processing on the relative ratio which has been 

generated as the defect information and corrects the value of the corresponding pixel in the 
image of the flat portion area by multiplying the pixel value by a reciprocal of the relative 
ratio having undergone the low pass processing, which corresponds to the pixel in the image 
of the flat portion area. 

60. (Withdrawn) An image processing apparatus according to claim 54, wherein: 
the flat portion extraction unit executes edge extraction within the photographic image 

and extracts an area in which no edge is extracted as a flat portion area. 

61 . (Withdrawn) An image processing apparatus according to claim 54, wherein: 
the flat portion extraction unit includes a gradation conversion unit that executes 

gradation conversion on the photographic image and executes a flat portion area extraction on 
the photographic image having undergone the gradation conversion. 

62. (Withdrawn) An image processing apparatus according to claim 61, wherein: 
when gradation of the photographic image is indicated with a linear signal, the 

gradation conversion unit converts the linear signal to a nonlinear signal and executes 
conversion by enlarging the gradation on a low intensity side and compressing the gradation 
on a high intensity side. 

63. (Canceled) 
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64. (Withdrawn) An image processing apparatus according to claim 62, wherein: 
the gradation conversion unit executes conversion by using a square root function. 

65. (Canceled) 

66. (Withdrawn) An image processing apparatus according to claim 60, wherein: 
the edge extraction is executed by calculating differences corresponding to a plurality 

of distances between a target pixel and surrounding pixels along a plurality of directions. 

67. (Withdrawn) An image processing apparatus according to claim 55, further 
comprising: 

a luminance level decision-making unit that makes a decision as to whether or not a 
luminance level of the photographic image is equal to or higher than a predetermined 
luminance level, wherein: 

the correction unit executes correction for an area determined to be a flat portion area, 
where the luminance level is equal to or greater than the predetermined level. 

68. (Withdrawn) An image processing apparatus according to claim 54, further 
comprising: 

a reference image obtaining unit that obtains a reference image captured with the 
image sensor; and 

a reference image defect information generating unit that generates defect information 
corresponding to the reference image, wherein: 

the defect information generating unit generates the defect information corresponding 
to the flat portion area by using area information included in the defect information for the 
reference image and area information corresponding to the flat portion area in combination. 

69. (Withdrawn) An image processing apparatus according to claim 68, wherein: 
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if an area that is not extracted as the flat portion area is still indicated to be a defect 
area by the defect information for the reference image, the flat portion extraction unit extracts 
the defect area as a flat portion area. 

70. (Withdrawn) An image processing apparatus according to claim 68, wherein: 
the defect information generating unit generates the defect information for an area 

indicated as a defect area by the defect information for the reference image and also 
determined to be the flat portion area. 

71 . (Withdrawn) An image processing apparatus according to claim 68, further 

comprising: 

a defect information conversion unit that converts the defect information for the 
reference image to defect information equivalent to defect information for a reference image 
photographed under optical conditions identical to optical conditions under which the 
photographic image has been photographed when the photographic image and the reference 
image have been photographed under different optical conditions, wherein: 

the defect information generating unit uses the defect information for the reference 
image resulting from the conversion. 

72. (Withdrawn) An image processing apparatus according to claim 69, further 

comprising: 

a defect information conversion unit that converts the defect information for the 
reference image to defect information equivalent to defect information for a reference image 
photographed under optical conditions identical to optical conditions under which the 
photographic image has been photographed when the photographic image and the reference 
image have been photographed under different optical conditions, wherein: 

the flat portion extraction unit uses the defect information for the reference image 
resulting from the conversion. 
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73. (Withdrawn) An image processing apparatus according to claim 72, wherein: 
in consideration of an error in defect information conversion executed by the defect 

information conversion unit, the defect information generating unit expands the defect area 
indicated by the defect information for the reference image, at least by an extent 
corresponding to the error in the defect information conversion. 

74. (Withdrawn) An image processing apparatus according to claim 54, wherein: 
the image obtaining unit obtains a plurality of photographic images captured with the 

image sensor; 

the flat portion extraction unit extracts the flat portion area in each of the plurality of 
photographic images; and 

the defect information generating unit generates defect information corresponding to 
the flat portion area in one of the plurality of images by using images of flat portion areas in 
the plurality of images having been extracted. 

75. (Withdrawn) An image processing apparatus according to claim 54, wherein: 
the image obtaining unit obtains a plurality of photographic images captured with the 

image sensor; 

the flat portion extraction unit extracts the flat portion area in each of the plurality of 
photographic images; and 

the defect information generating unit generates defect information corresponding to 
an entire image of each of the plurality of images by using images of flat portion areas in the 
plurality of images having been extracted. 

76. (Withdrawn) An image processing apparatus according to claim 75, wherein: 
the defect information corresponding to the flat portion area is generated based upon a 

value at a target pixel and an average value of a plurality of pixel values corresponding to 
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pixels present within a predetermined range containing the target pixel in the image within 
the flat portion area. 

77. (Withdrawn) An image processing apparatus according to claim 76, wherein: 
the defect information generating unit includes a relative ratio calculation unit that 

calculates a relative ratio of the value at the target pixel and the average value of the plurality 
of pixel values corresponding to the pixels present within the predetermined range containing 
the target pixel, and generates the defect information corresponding to the flat portion area 
based upon the calculated relative ratio. 

78. (Withdrawn) An image processing apparatus according to claim 69, wherein: 
if there are a predetermined number of pixels or more pixels from which an edge has 

been extracted are present around the defect area indicated by the defect information for the 
reference image, the flat portion extraction unit does not extract the defect area as the flat 
portion area. 

79. (Withdrawn) An image processing apparatus according to claim 78, wherein: 
if an edge has been extracted from a majority of pixels among pixels present in a 

predetermined area surrounding a pixel in the defective area, the flat portion extraction unit 
does not extract the pixel in the defect area as a pixel in the flat portion. 

80. (Previously Presented) A computer-readable computer program product 
having an image processing program enabling a computer to execute functions of an image 
processing apparatus according to claim 1 . 

81. (Canceled) 

82. (Canceled) 
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83. (Currently Amended) An image processing apparatus according to claim 
SSclaim 1, wherein: 

the defect information generating unit generates defect information for an area within 
the image, which satisfies a predetermined condition. 

84. (Canceled) 

85. (Currently Amended) An image processing apparatus according to claim 
8 4claim 8 , wherein: 

the relative ratio calculation unit sets the calculated relative ratio to 1 if the calculated 
relative ratio falls within a predetermined range containing 1 . 

86. (Previously Presented) An image processing apparatus according to claim 85, 
wherein: 

the relative ratio calculation unit correlates the predetermined range over which the 
calculated relative ratio is set to 1 with a standard deviation value of the calculated relative 
ratio. 

87. (Previously Presented) An image processing apparatus according to claim 86, 
wherein: 

the relative ratio calculation unit sets the predetermined range over which the 
calculated relative ratio is set to 1 to a ± (3 x standard deviation value) range. 

88. (Withdrawn) A computer-readable computer program product having an image 
processing program enabling a computer to execute functions of an image processing 
apparatus according to claim 37. 

89. (Withdrawn) A computer-readable computer program product having an image 
processing program enabling a computer to execute functions of an image processing 
apparatus according to claim 54. 
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